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Chapter 1 

Introduction 



1.1 Preface 

The aim of this work is to try to bridge over theoretical immunology and disordered statistical 
mechanics. Our long term hope is to contribute to the development of a quantitative theoretical 
immunology from which practical applications may stem. 

In order to make theoretical immunology appealing to the statistical physicist audience we are 
going to work out a research article which, from one side, may hopefully act as a benchmark for 
future improvements and developments, from the other side, it is written in a very pedagogical way 
both from a theoretical physics viewpoint as well as from the theoretical immunology one. 

Furthermore, we have chosen to test our model describing a wide range of features of the adap- 
tive immune response in only a paper: this has been necessary in order to emphasize the benefit 
available when using disordered statistical mechanics as a tool for the investigation. However, as a 
consequence, each section is not at all exhaustive and would deserve deep investigation: for the sake 
of completeness, we restricted details in the analysis of each feature with the aim of introducing a 
self-consistent model. 

1.2 Immune system and statistical mechanics 

The purpose of the immune system is to detect and neutralize the molecules, or cells, dangerous for 
the body (antigens, which could be foreign invaders - e.g. viruses or bacteria - or deranged - e.g. 
cancerous - cells of the host), without damaging healthy cells [9j. Despite of the evident differences, 
to accomplish its function, the immune system exhibits properties analogous to the nervous system 
|45) : it "learns" not to attack healthy cells and it "develops a memory" of the pathogens encountered 
as time goes by. In theoretical immunology there are two main strands to explain the functioning 
of the immune system that ultimately represent two approaches, reductionist and systemic for the 
modeling of nature in general. In the first and most popular approach, lymphocytes basically operate 
independently or, better, the researcher focuses on the action of the single lymphocyte and on the 
details of its interactions (i.e. internal cascade signals, etc.) rather than on the global behavior of all 
the lymphocytes interacting with each other. In the second approach, pioneered in immunology by 
Elrich |[6j and Jerne [32j . the immune system is thought of as a whole and designed as a network of 
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cells stimulated to proliferate by the affinity interactions of their exchanging antibodies (a functional 
idiotypic network [22]). Interestingly, the two approaches are not incompatible but complementary. 
While the former deals primarily with the response to a stimulus, the latter allows to explain the 
ability to learn and memorize of the immune system and the tolerance to low doses of antigen 
|61) . In the past, the immune network theory has been investigated, although not exhaustively, 
with disordered statistical mechanics tools [25]. However, recent and deep advances in the field 
of statistical mechanics of highly diluted networks |17| l371 ISUj l52l ISH [59j now allow to combine 
the two viewpoints described above and to develop a unified and quantitative theory. Indeed, 
reductionist and systemic approaches can be recovered as special cases of null and not-negligible 
connectivity respectively. This unification should be extremely promising from a biological as well 
as mathematical point of view. 

To sketch our viewpoint on the systemic approach we make the following parallel: the immunol- 
ogist wonders about the details, even "hyperfine", of the structure and about the interaction of the 
lymphocyte with its "particular environment". Analogously, the condensed matter physicist studies 
the molecule of water in every detail, from the angle between hydrogen atoms to the constructive 
interference between the orbital of hydrogen and of oxygen. This speculation is fundamental, yet 
not exhaustive. In fact, from these details, which allow an accurate description of the molecule, 
we are not able to deduce, the "emerging properties of the network" of molecules (e.g. a water-ice 
phase transition) as the control parameters (pressure and temperature) are tuned. Indeed, these 
phenomena do not depend significantly on the details of the molecule structure but rather on the 
collective effects due to the interactions of large numbers of these molecules and the study of such 
effects is just the goal of statistical mechanics. Hence, within this framework, we want to read the 
theory of the immune networks. 

In a nutshell, statistical mechanics (for discrete systems as the one considered here, i.e. Curie- 
Weiss theories |14 | I18 | [51] and their complex generalizations |12l I15| [T6l 158] ) is a powerful approach 
to this problem. Within the one-body interaction with the external stimuli, it can describe the 
behavior of the single clone (made up of a set of identical lymphocytes) with its coupled antigen, 
while, with the two-body interaction, it can describe the clone networks; in this way, interpolating 
between the two, we can recover the two prototypes of theoretical immunology; furthermore this 
approach is strongly based on probability theory and on physical variational principles which allow 
to make the theory even quantitative and predictive. 

Turning to the object of application, immunology became so far one of the most investigated 
field of science and the plethora of its variegate scientific outcomes increases enormously year by 
year, such that trials for a general unifying theory should be attempted. 

We start by introducing the one-body theory and noticing that in immunology it corresponds 
to what we call a "Burnet-like behavior", then we extend our model including the two-body theory 
and show that it recovers what we call a "Jerne-like behavior"; as a natural consequence, we will 
show how this extends the approach of Counthino-Varela for the systemic self /non-self distinction 
|27| 128]. After these results, we show how hysteresis, with its remanent magnetization, can play the 
role of the generator of memory cells from plasma cells, according to the Clonal Selection Theory 
m [5]. Finally, we show how low- and high-dose tolerances, as well as the bell-shaped response, 
appear as emergent features in our model, while in theoretical immunology analysis they are often 
postulated a-priori. 

Even though not exhaustive, our model may act as an alternative starting backbone for this 
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field of research. 

1.3 Theoretical immunology through complex system glasses 

The immune system exhibits an extremely broad ensemble of characters, however we are going to 
focus just on a subset of the whole system, namely the one constituted by B lymphocytes and 
their related immunoglobulins. Despite being a small part of the immune system, it is the main 
constituent of the adaptive response and, basically, the core of the system; furthermore, similar 
considerations may hold, with little modifications, even for the T-killer response, ultimately the 
adaptive system as a whole (apart from the fundamental T-helper regulations, which from disordered 
statistical mechanics viewpoint are closer to pure glassy models and quite different from the scenario 
we propose here, see [25j). 

In the following, no mention to any other element (neutrophils, macrophages, APC, etc) will be 
made and we refer to specialized textbooks for their introduction |9j, although their knowledge is 
not a prerequisite for reading the manuscript. 

Let us just sketch, for the sake of clearness, that we are trying to model the B-core of the immune 
system (as well as the T-killer core) as imitative, eliciting, models: Stimulation is expressed by a 
firing lymphocyte towards its nearest neighbors while suppression is expressed by a quiescent one. 
Hence, in our scheme, it is not the sign of the coupling to establish the kind of interaction, i.e. 
positive for imitative interaction and negative for anti-imitative interaction, which here is always 
positive or zero, but the state of the single lymphocyte itself. 

Frustration surely is expected to appear in the immune system, but, in our approach, it is 
encoded into the T-helper regulation of the two core (B, T-killers) responses, which deserve another 
work for its investigation. 

1.3.1 Clonal expansion and one body perspective 

The main constituents of an (adaptive) immune system are B-lymphocytes (B-cells), together with 
the T-lymphocytes, and free antibodies produced by B-cells. B-cells and T-cells have specific protein 
molecules on their surfaces, called receptors. The receptors of B-cells are antibodies (Immunoglob- 
ulin, Ig), which can recognize and connect to antigens in order to neutralize them. Finally, the 
purpose of killer T-cells is to attack and kill infected or deranged cells. The receptors of B- and 
T-cells have specific 3-dimensional structures, called "idio types". A family of B-cells generated by a 
proliferating B-cell are called "clones"; a clone and the antibodies which it produces have the same 
idiotypes. 

In a healthy human body at rest, it is estimate that the total number of "sentinel" clones 
generated from a single B-cell (the amount of identical lymphocytes) is about 10^ to 10^, the total 
number of clones amounts to some 10^^ — 10^^ (such that diverse clones are around 10^° - lO^^^ and 
the number of antibodies is about 10^^; remarkably the amount of epitopes/idiotopes belonging to 
a given antibody are present in a smaller number, i.e. order of 10^. 

When antigens enter the body, those clones which recognize it will bind to it. Aided by helper T- 
cells, B-cells of an activated clone will proliferate, becoming antibody producing cells. The latter will 
secrete large numbers of free antibodies, which attach to antigen, neutralize it, and trigger killer 
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cells into action. The above is (a part of the) "clonal selection theory" and has been confirmed 
experimentally. 

We notice that this approach, pioneered by Burnet takes into account an enormous amount 
of different data, and absolutely does not rely on interactions among different lymphocytes, as it 
deals with the external antigen interaction with the immune system, where the network works at a 
completely hidden level. 

Edelman first realized how the principal features of Burnet theory was its bridge over a de- 
scription in terms of antibodies and one in terms of cells, implicitly defining the first postulate of 
immunology (which has been always verified so far) |29| : 

Each clone of B-cells produces always the same antibody (hyper-mutations apart which will not 
be discussed here - see for instance |20| |2T] - and should pave the way to learning |19|). so a given 
clone i may be composed by M identical lymphocytes each producing the same identical antibody 
and the immune system is built by N of these clones. 

1.3.2 Immunoglobulin network and two bodies perspective 

The idea of an internal network appeared early in immunology |^, and its concretization happened 
when Jerne, in the 70's, suggested that each antibody must have several idiotopes which are detected 
by other antibodies. Via this mechanism, an effective network of interacting antibodies is formed, in 
which antibodies not only detect antigens, but also function as individual internal images of certain 
antigens and are themselves being detected and acted upon. These network interactions provide a 
"dynamical memory" of the immune system, by keeping the concentrations of antibodies (especially 
those representing encountered antigens) at appropriate levels. This can be understood as follows: 
At a given time a virus is introduced in the body and starts replication. As a consequence, at 
high enough concentration, it is found by the proper B-lymphocyte counterpart: let us consider, for 
simplicity, a virus as a string of information (i.e. 1001001). The complementary B-cell producing 
the antibody Igl, which can be thought of as the string 0110110 (the dichotomy of a binary alphabet 
in strings mirrors the one of the electromagnetic field governing chemical bonds) then will start a 
clonal expansion and will release high levels of Igl. As a consequence, after a while, another B-cell 
will meet 0110110 and, as this string never (macroscopically) existed before, attacks it by releasing 
the complementary string 1001001, that, actually, is a "copy" (internal image) of the original virus 
but with no DNA or RNA charge inside. The interplay among these keeps memory of the past 
infection. However, in the 90's, the network theory was considered to be strongly marginal: It did 
not appear as a part of a whole although it gave an appealing mechanism for the implementation 
of memory in the immune system. 

1.3.3 Tolerance, responsiveness and autoimmunity 

Beyond memory storage, another featured by the immune system is very impressive: it is able to 
attack antigens but not host molecules or cells. Immunologist name this ability as the distinc- 
tion among se//and non-self. Self/Non-Self discrimination is of fundamental importance as several 
disease may appear if it is non-properly working (this is the case of auto-immune pathologies [63]). 

In a nutshell, following the classical vision and according to (sometimes called reductionist j29) ) 
antigen-driven view of the immune system, newborn lymphocytes learn from the beginning the 
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difference among self and non-self (it is assumed the existence of an a-priori learning in specific 
regions of the body - i.e. thymus - where all the lymphocytes are made to interact with self and all 
the responding ones are killed). As a consequence, the presence of autoimmunity in the system is 
due to a non proper elimination of those B-cells which, at their early stage, failed to learn such a 
difference. This defines the allopoietic viewpoint. 

It must be stressed that without a two-body interaction, which makes possible the existence of 
a network, this property can not be spread on the whole system and, indeed, we must assume that 
each lymphocyte stores the whole required information by itself, namely the reductionist viewpoint. 

However, within the idiotypic network theory started by Jerne, the emergence of an interaction 
network allows the following speculations on autopoiesis due to Varela, Counthino and coworkers 
|27| 128) : The mutual interaction among lymphocytes rules out the need of an a-priori learning for 
these cells, as tolerance to self may turn out to be an emerging property of the immune network 
thought of as a whole. In fact, it is the modulation and the mutual influence among interacting 
immunoglobulins (and their corresponding clones indirectly) that imposes quiescence or responsive- 
ness of the clones as a consequence of a given stimulus, which may be "self" or "non-self" as well. In 
other words, antibodies are randomly produced and, as a consequence, may react against anything 
(their idiotopes form somehow a "base" in a proper space), however clones producing self-reacting 
antibodies are always taken quiescent, in such a way that they can produce only low - but not zero 
- concentrations of Igs [63j, by the interaction with the network of all the others. Indeed, we stress 
that experimentally low dose of self-antibodies are commonly found in healthy bodies |241 126| . 

We finish this section reporting, at a minimal descriptive level, other universal, basic features 
displayed by the immune system [9l |25] : 

• Low Dose Tolerance: the immune system does not attack proteins (of whatever kind, antigens 
or self-proteins) if their concentration is below a threshold, whose value strongly depend on 
the particular protein itself. 

• High Dose Tolerance: the immune system does not attack them either if their concentration 
is too high. 

• Bell Shaped Response: the typical form of the immune response (which may vary in amplitude 
and length) is the so called "Bell-Shaped Response". 

• Development of memory cells: During the fight against the infection the immune system 
stores information of the encountered antigen developing memory cells, which, in a possibly 
secondary re-infection, produce more-specific antibodies and in greater quantity. 

• Multi- attachment ability: when an antigen is encountered and a "segment" of this is presented, 
thought APC, to the adaptive responders, not only one, but rather an ensemble of antibodies 
is usually produced to fight the infection. 

• Self vs non-self discrimination: cells or proteins belonging to the body are never macroscopi- 
cally attacked by the immune system. 
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Chapter 2 

The minimal model 



Conceptually we reserve this chapter to a derivation of a Hamiltonian for the lymphocytes, which 
will play the role of the spins in standard statistical-mechanics models. In the next chapter we will 
focus on the immunoglobulin, which will build the interaction matrix for the lymphocyte clones and 
this will define the model. All the rest of the paper will show its features. At the end we stress 
that we work out the theory paying attention only at its finite - and finite M - behavior, so to 
compare with data. 



2.1 Antibodies as vectors in the base of idiotopes 



We want to formalize this scenario within a statistical mechanics context where interacting antibod- 
ies ultimately reflect the interaction among lymphocytes due to the one-to-one postulate previously 
introduced: from a "field theory language" |64) . the antibodies are the "fields" that the lymphocytes 
produce for interacting: these can interact both among themselves and directly with the lympho- 
cytes. As the ratio among the amount of antibodies versus lymphocytes is much greater than one 
we focus primarily on the antibody-antibody interaction, how to extend this to the former case is 
straightforward as lymphocytes display antibodies on their external surface. 

In order to get a network of Igs links, we relax the earlier simplifying assumption of "a perfect 
mirror of a mirror" for the interacting Igs. In fact, we are going to consider interactions among 
antibodies formed by idiotopes such that the better the matches among idiotopes, the stronger the 
stimulus received by the respective clones via their immunoglobulins. 

We consider the most generic antibody as a chain made of by the possible expression of L 
idiotopes. The assumption that each antibody can be thought of as a string of the same length is 
based on two observations: the molecular weight for each Igs is very accurately close to 15 • 10^ 
and each idiotope on average is large as each other ("all the gamma-globulins have structural 
characteristic surprisedly similar" [7|). 
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As a consequence the L idiotopes may act as eigenvectors, 

6 = (1,0,0,...,0) 

6 = (o,i,o,...,o) 

a = (0,0,0,...,1). 

(2.1) 

They form an orthogonal base in the L-dimensional space of the antibodies T. A generic antibody 
^* can then be decomposed as a hnear combination of these eigenvectors {,^*} = A^^i, X2(,2, •••> ^^l^l, 
with AJ^ € (0, 1) accounting for the expression (1) of a particular fJ^ idiotope on the i^^ antibody 
or its lacking (0). 

In this way the earlier distinction among epitope and paratope suggested by Jerne is avoided (as in 
several recent approaches to theoretical immunology |2l El [HI E] ) and is translated into a comple- 
mentary product that we will define sharply in the next chapter. 

Roughly speaking, within the previous example (see sec. 1.2. 2), both the strings (1001000), (1001001) 
are reactive with (0110110), but the second is better as it matches all the entries. As a counterpart 
the strings with several differences in idiotope/epitope linking (i.e. 0111110 in the same example) 
do not match and the corresponding lymphocytes are disconnected in the network they belong to (it 
is straightforward to understand that there are no links inside the lymphocytes of the same clone, 
namely they act paramagnetically among each other). The fact that the interaction of two Ig's is 
stronger when their relative strings are more complementary responds to the kind of interaction 
among their proteic structures: protein-protein interactions are dominated by weak, short-range 
non covalent forces which arise when the geometry of the two proteins are complementary, whatever 
structures are assumed. 

This naturally enlarges the idea of "mirror of mirror" into an affinity matrix Jij > 0, which, 
although described throughout in the next chapter, will be used now as the starting point of the 
following speculation. 



2.2 One-body and two-body Hamiltonian 

In this section we are going to introduce the "Hamiltonian" of our system. The Hamiltonian H 
encodes the interactions among lymphocytes as well as the interactions among lymphocytes and 
the external antigens, providing a measure for the "energy" of the system. For the reader with no 
physics background we will summarize the key concepts of statistical mechanics and thermodynam- 



ics, directly applied in immunology, in the section (2.3.3). 

First of all, let us formalize the interactions taking place within the system. We consider an 
ensemble of M identical lymphocytes af, a = 1,...,M, all belonging to the z*'* clone and N all 
different clones i = 1, A^. 

In principle M, the size of available "soldiers" within a given clone (in an healthy human body at 
rest), can depend by the clone itself, such that M — )• Mj. However, for the sake of simplicity, we 
are going to use the same M for all the clones, at least in equilibrium and in the linear response 
regime. 
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If the match among antibodies had to be perfect for recognizing each other, then in order 
to reproduce all possible antibodies obtained by the L epitopes, the immune system would need 
N ~ 0{2^) lymphocytes. Conversely, if we relax the hypothesis of the perfect match, only a fraction 
of such quantity is retained to manage the repertoire, such that we can define the following scaling 
among lymphocytes and antibodies: 

iV = /(L)exp(7L), (2.2) 

where 7 S [0, 1] encodes for the ratio of the involved lymphocytes (the order of magnitude) and 
/(-L) is a generic rational monomial in L for the fine tuning (as often introduced in complex systems 
[62) . we will see that f{L) ~ /L). 

Interestingly, a far-from-complete system is consistent with the fact that binding between anti- 
gens and antibodies can occur even when the match is not perfect: experimental measurements 
showed that the affinity among antibody and anti-antibody is of the order of the 65/70 percent 
or more (but not 100%) |2l HI HTj US]. Furthermore the experimental existence of more than one 
antibody responding to a given stimulus (multiple attachment [T]) confirms the statement. 

We can think of each lymphocyte as a binary variable af S ±1 (where i stands for the ith clone 
in some ordering and a for the generic element in the i subset) such that when it assumes the value 
— 1, it is quiescent (low level of antibodies secretion) and when it is -|-1 it is firing (high level of 
antibodies secretion). 

The ability of newborn lymphocytes to spontaneously secreting low dose of its antibody (corre- 
sponding to its genotype) even when not stimulated is fundamental in order to retain the network 
equilibrium and can be deepen in |30) . We stress once again that within our approach the upper 
bound of the available firing lymphocytes is conserved M 7^ M{t) so the exponential growth of a 
clone when expanding after the exposition to the external antigen, is translated here in the growing 
response of a clone to the external field by which, from a situation with almost all its M are in the 
state (Tj = —1 switches to a scenario with all fjj = -|-1. 

To check immune responses we need to introduce the N order parameters rrii as local magneti- 
zations 

M 
a=l 

where i labels the clone and a the lymphocyte inside the clone's family; The vector of all the m^'s 
is depicted as m and the global magnetization as the average of all the mi as (m) = A^~^ 'Y^^ mi. 

It is important to stress that the magnetizations, which play the role of the principal order 
parameters, account for the averaged concentration of firing lymphocytes into the immune network, 
such that as m, G [—1,1] we can define the concentrations of the firing i^^ lymphocytes as 

r = logM. (2.4) 

Note that the concentration is not normalized and ranges over several orders of magnitude, from 
0(10*^) when no firing lymphocyte is present up to 0(10^^) ~ M when all the lymphocytes of 
the ith clone are firing. Strictly speaking, the quiescence of a given clone is a collective state 
where ~ 10^/10^ clones are present; this can be understood, within a thermodynamical framework. 



Ci{t) = exp 



(mi(t) + l) 
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relaxing the idea that the system works at "zero-temperature" (that is not really physical), in fact, 
a small amount of noise would change the quiescent concentration from strictly 1 to a slightly higher 
value. 

Now, let us turn to the external field and start with the ideal case of perfect coupling among a 
given antigen and its lymphocyte counterpart: let us label the antigen displaying a sharp match 
with the i-th antibody, hence described by the string ^f^i = ^j. In general, for unitary concentration 
of the antigen, the coupling with an arbitrary antibody fc is /i^. 

Following classical statistical mechanics |141I51|. the interaction among the two can be described 

as 

N 

Hi = -Y,Kmk, (2.5) 

k 

such that if we suppose that at the time t the only applied stimulus is the antigen h-*- , all clones but 
1, namely i = 2, A^, remain quiescent: the interaction term among the system and the stimulus is 
simply Hi = —h\mi. Note that within this Hamiltonian alone the immune system is at rest apart 
from the clone i = 1 which is responding to the external offense and that if we apply contemporary 
two external antigens /ii(t), ^2(^5 the response is the sum of the two responses. 

Of course also the generic external input h, stemming from the superposition of L arbitrary 
elementary stimuli, can be looked as the effect of a string ^ which can written in the idiotype 
basis such that = Y^^^i \ Ci- Moreover, in order to account for the temporal dependence of the 
antigen concentration we introduce the variable c{t) accounting for its load at the time t, such that, 
generically, several lymphocytes attack it (we will quantify the response in the next chapter), as 
commonly seen in the experiments p,]. 

As we discussed, it is reasonable to believe that all the immunoglobulins have the same length 
L, on the other hand this is not obvious for antigens which may arrive from different organisms 
and places, such that their interactions with the immune system may be different. In a nutshell, 
referring the reader to specific textbook, let us only remark that Antigen Presenting Cells, which 
are immune agents with the role of presenting the antigens to the lymphocytes, before accounting 
for these meetings, desegregates the enemies in pieces of "information length" of order L and put 
them on the proper surface |9]. 

So far we introduced the (reductionist) one-body theory, whose "Hamiltonian" is encoded into 
the expression Hi. If we now take into account a "network" of clones we should include their 
interaction term H2- Coherently with Hi we can think at 

N,N 

H2 = -N-'^ JijUiirrij. (2.6) 
i<j 

As anticipated, the Hamiltonian is the average of the "energy" inside the system and thermo- 
dynamic prescription is that system tries to minimize it. As a consequence, assuming Jij > 0, the 
energies are lower when their constituents behave in the same way. For H2, two generic clones i 
and j in mutual interactions, namely Jij > 0, tend to imitate one another (i.e. if i is quiescent, it 
tries to make j quiescent as well -suppression-, while if the former is firing it tries to make firing 
even the latter -stimulation-, and symmetrically j acts on i). 
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It is natural to assume Jij as the affinity matrix: it encodes how the generic i and j elements 
are coupled together such that its high positive value stands for an high affinity among the two. 
The opposite being the zero value, accounting for the missing interaction. 

If we consider the more general Hamiltonian H = Hi + H2 we immediately see that in the case 
of Jij = for all i,j we recover the pure one-body description and the antigen-driven viewpoint 
alone. Different ratio among the weighted connectivity Wi = Y2j Jij ^^"^ ^« interpolate, time by 
time, among two limits for each clone i. 

2.3 Approaching a statistical mechanics formulation 

In this section we introduce the basic principles of stochastic dynamics for the evolution to equi- 
librium statistical mechanics of the system we are interested in. Even though for discrete systems 
two kinds of dynamics are available, parallel and sequential, we are going to deepen only the latter 
as it is the one we will implement in this work. 

The argument is well known and several mathematical textbooks are available |19| |23] (the 
expert reader may safely skip to Sec. (2.3.3)), however, for the sake of completeness we briefly 
summarize the fundamental steps directly implementing them into the immunological framework 
we model. 

2.3.1 Master equations and Markov process 

We saw that the average behavior of the generic ith. clone is expressed via rrii = '^f- The 

interactions among the clones and the external stimuli are encoded into the Hamiltonian as follows 



Note that there are no interactions among lymphocytes belonging to the same clone [Ja = 0). 

For the moment there is no need to define explicitly the topology of the underlying immune 
network as the scheme applies in full generality. We only stress that Jij is quenched, i.e. it does 
not evolve with time, or at least it evolves on slower timescales w.r.t. the ones involved by the cj's 
(this ultimately reflects the difference among which genotype and phenotype evolve |65] and is the 
usual approach in closer context, i.e. neural networks [llj). Jij plays the role of the affinity matrix 
and can be thought of as a weighted symmetric adjacency matrix |13| . 

Once defined the field hi acting on the generic ith clone at time the state of the system at this 
time is given as the average of all its building lymphocytes, each of which evolving time-step by 
time-step via a suitable dynamics. 

Following standard disordered statistical mechanics approach [55j we introduce the latter accordingly 
to 



N,N 



N 




(2.7) 





where (pi{t) is the overall stimulus felt by the i-th lymphocyte, given by 



N 




(2.9) 



3 
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end the randomness is in the noise implemented via the random numbers r/f, uniformly drawn over 
the set [—1, +1]. (3 rules the impact of this noise on the state erf (t + 1), such that for /3 = oo the 
process is completely deterministic while for 13 = completely random]^ 

In this framework the noise can be though of as made by several different agents as the concentration 
of free radicals (which bind randomly, decreasing the strength of the interactions) or the concen- 
tration of fat molecules as cholesterol, which speeds down the drift velocity for the lymphocytes 
decreasing the effective connection among them (as a big difference with neural networks, whose 
graphs have neurons as nodes and synapses as links, in immune networks the graph underlying the 
model is intrinsically dynamical as depends by the blood flow instead of static neuronal tissues [35]). 
In the sequential dynamics, under the assumption M << A^, at each time step t a single lymphocyte 
It -randomly chosen among the M x A^- is updated, such that its evolution becomes 

^K(i + 1)] = ^(l + <(t)tanh(/3A;aO)), (2-10) 

whose deterministic zero-noise limit is immediately recoverable by sending /3 — t- oo. 
If we now look at the probability of the state at a given time t -|- 1, Pt+i(cj), we get 

1 1 "^'""'l 

Pt+i{<^) = ^^5]-(l + aftanh(/3fc,(a)))Pi(cT) (2.11) 

1 1 '^''''l 

+ NmH -(1 + af tanh(/3/c,(F»))Pt(i^V), 

where we introduced the M x N flip-operators -F", i E (1, N), a £ (1, M), acting on a generic 
observable 0(cr), as 

<I>(cri , -h (Tj ,...,crjv,cr^[,-.-,CTjv>--->C^l >---)f^Af j = l^.lij 
= <I>(fTi , - (7j ,...,CTjv,0-^,---,0-jv,---,0-i ,...,a;V 

such that we can write the evolution of the immune network as a Markov process 

pt+i("i) = V'M^[m;m']pi(m'), (2.14) 



N M 

N M 



W[m; m'] = 6m,m' + X] X] ['^iiPi'^)^m,Fm' " w'f{m)5m,r, 

=1 0=1 



with the transition rates wf{m) = ^[1 — af tanh{Pki)]. 

^The reader not acquainted with statistical mechanics may find the above equations somewhat obscure, in which 
case, he may deepen the hnk among the (rather unfamiUar) hyperbolic tangent and the (much more familiar) logistic 
function usually introduced in experimental data analysis in medicine |68) to realize the freedom allowed beyond this 
choice. 
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2.3.2 Detailed balance and symmetric interactions 

If the affinity matrix is symmetric, detailed balance ensures that there exists a stationary solution 
Pooim) such that (restricting hi[t) hi £ (1, ...,N)) 

W[m,m']Poo{m') = W[m' ,m]Poo{m). 

As the model fulffils this requisite, we want to deepen its implication to detailed balance at least in 
the /3 — 7- oo limit, which makes the evolution a deterministic map holding for each a G (1, M). 
This key feature ensures equilibrium and is worked out specifically as 

cosh(/3/ij(Fjm)) cosh(/3/ij(m)) ' 

which implies 

N N 

\2N 



Poo(<7; J, (X exp (^'^ Jij{a)mimj - = exp (' - l3HN{cr; J)), (2.15) 



namely the Maxwell-Boltzmann distribution [23] for the Hamiltonian (2.7). 

In absence of external stimuli, and skipping here the question about the needed timescales for 
"thermalization", the system reaches an equilibrium that it is possible to work out explicitly as we 
are going to show. 

It is important to stress that the concept of equilibrium here has nothing to share with a general 
equilibrium of the body. It simply means equilibrium with respect to a particular choice of the 
quenched antibody network (ultimately encoded into the Jij). 



For this detailed balanced system furthermore, the sequential stochastic process (2.8) reduces to 
Glauber dynamics such that the following simple expression for the transition rates Wi can be 
implemented 

Wi{m) = (l + exp{P AH {ai;J))^ \ AH {ai; J) = H {F^m; J) - H {m; J) , (2.16) 
and will indeed be used in simulations through the paper. 

2.3.3 Minimum energy and maximum entropy principles 

In the previous section we showed that, if the affinity matrix is symmetric, so that detailed balance 
holds, the stochastic evolution of our immune model approaches the Maxwell-Boltzmann distribution 



(see eq.(2.15)), which determines the thermodynamic equilibria. 

Thermodynamics describes the macroscopic features of the system and statistical mechanics 
allows to obtain such a macroscopic description starting by its microscopic foundation, so to say, 
obtaining the global immune behavior by studying the whole single lymphocyte actions, and then, 
using Probability Theory (thanks to the large numbers of these agents), for averaging over the en- 
semble with the weight encoded by -Poo('7; J, h). 

This scenario is achievable when both the "internal energy" density of the system u(l3) and the 
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"entropy" density s{/3) are explicitly obtained: 

In a nutshell, in physics, the energy of the system is defined as the intensive average of the Hamil- 
tonian tt(/3) ~ N~^{HN{a; J,h)), while the entropy = Yla ^ooio", J, h) log Poo{(t; J, h)) is a 

measure of information stored inside the network: 

When mapping from physics, we found implicitly paved the bridge with immunology; in fact, as 
suggested in [46], the two important "thermodynamic observables" of the immune system are its 
economy and its specificity. Still following |46j if we assume that the immune system tries to maxi- 
mize its specificity (entropy in our parallel) and to minimize its cost (energy in the same parallel) 
the way to statistical mechanics is naturally merged. 

Then the two prescription of minimizing the energy ?x(/3) (minimum energy principle) and maxi- 
mizing the entropy s{/3) (second law of thermodynamics) with respect to the order parameters give 
the full macroscopic behavior of the system. 

We stress that the same approach, which may appear strange to researchers not involved in complex 
statistical mechanics, holds successfully in several different fields, from the closer neural networks 
im 116] , to social or economic frameworks |55| l56l 157] or computer science |53] . 

To fulfil these prescriptions the free energy /(/3) = tt(/3) — l3~^s{/3) comes in help because, as 
it is straightforward to check, minimizing this quantity corresponds to both maximizing entropy 
and minimizing energy (at the given level of noise). Furthermore, and this is the key bridge with 
stochastic processes, there is a deep relation among statistical mechanics and their equilibrium 
measure Poo in fact 

— E 

Pooia;J,h)^eM-f3H{a-J,h)), /(/3) ^ — log ^ exp(-/3i7;v(cT; J, Z^))- 

(7 

Hence, once the microscopic interaction laws are encoded into the Hamiltonian, we can achieve a 
specific expression for the free energy, from which we can derive 

n(/3) = -d^{/3fm = N-\Hia;J,h)), (2.17) 
s{P) = f{p) + r^dp{Pf{P)). (2.18) 

The operator E that averages over the quenched distribution of couplings makes the theory not 
"sample-dependent": For sure each realization of the network will be different with respect to some 
other in its details, but we expect that, after sufficient long sampling, the averages and variances of 
observable become unaffected by the details of the quenched variables. 
The Boltzmann state is given by 

u{^a, J)) = —I— ^(^; J)e-'^^-('^'^), (2.19) 
and the total average ($) is defined as 

(cI>)=E[u;($(a,J))]. (2.20) 



It is easy to check that when the level of noise is too high (/3 — t- 0), details of the Hamiltonian are 
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unfelt by the clones, so that each clone behave independently of each other. 

At the contrary, when the level of noise is not too high and the system may experience the rules 
encoded into the Hamiltonian, it is easy to see that 

-^-M^ = im.)^0, y-M^ = im.m,)^0. (2.21) 

Namely, the response of the system to the i*^ external stimulus is encoded into the i^^ order pa- 
rameter (the concentration of the corresponding clone, i.e. 1-body term) and the response to the 
affinity matrix is encoded into the correlation among different clones (2-bodies term). 
Not surprisingly, the first description of the immune system, early formalized by Burnet looking 
at the response to infections deals with a one-body approach (it is the response to the external 
field), while the description of the memory by Jerne deals with the two body approach (able to 
store information into the network by breaking the ergodicity |12j). 
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Chapter 3 

Structure analysis 



We consider a system made of by N idiotypically different clones, each denoted with an itahc 
letter i and associated to a binary string of length L encoding the specificity of the antibody 
produced. Each entry /j, of the i-th string is extracted randomly according to the discrete uniform 
distribution in such a way that = 1 (^f = 0) with probability 1/2; this choice corresponds to 
a minimal assumption which can be possibly modified, yet preserving the structure of our model, 
only quantitative results will change accordingly. 

Now, given a couple of clones, say i and j, the ^-th entries of the corresponding strings are said 
to be complementary, iff ^ S^j. Therefore, the number of complementary entries Cij G [0, L] can 
be written as 



L L 



The affinity between two antibodies and, more generally, among two entities described by a vector 
in the idiotype basis, is expected to depend on how much complementary their structures are. In fact, 
the non-covalent forces acting among antibodies depend on the geometry, on the charge distribution 
and on hydrophilic-hydrophobic effects which give rise to an attractive (repulsive) interaction for 
any complementary (non-complementary) match. Consequently, in our model we assume that each 
complementary / non-complementary entry yields an attractive / repulsive contribute. In general, 
attractive and repulsive contributes can have different intensity and we quantify their ratio with a 
parameter a E M"^. Hence, we introduce the functional fa^L : T x T — )• M as 

fa,L{^i,Cj) = [acij - (L - dj)], (3.2) 

which provides a measure of how "affine" and are. In principle, fa,Li£,i,^j) can range from 
—L (when = ^j) to aL (when all entries are complemetary, i.e. = ^j). Now, when the 
repulsive contribute prevails, that is fa^i < 0, the two antibodies do not see each other and the 
coupling among the corresponding lymphocytes Jij{a,L) is set equal to zero, conversely, we take 



Jij{a,L) = exp[fa^L{CiT {J) a,Li being {J)a,L a proper normalizing factor (see Sec. 3.2). 

Otherwise stated, nodes can interact pairwise according to a coupling Jij{a, L), which is defined 

as: 

Ma,L) ^ e(/.,i(e.,e,))^^^%^^^, (3.3) 

{'J)a,L 
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where G(x) is the discrete Heaviside function returning x if x > 0, and if x < 0. 

Notice that the models introduced in |66| [67] also define the connections between antibodies, 
according to the number of matches between the chains representing antibodies. 

Some remarks are in order here. The choice of an exponential law connecting the affinity 
fa,L{ii,ij) between two strings and their relevant coupling Jij follows empirical arguments, in 
fact, we expect the latter to depend sensitively on how complementary the two strings are, possi- 
ble spanning several orders of magnitude. Notice that this choice is also consistent with Parisi's 
intuition [25]. Moreover, the prefactor l/{J)a,L is taken in such a way that Jij [] has finite (uni- 
tary) average for any value of a and L. More precisely, {J)a,L is just the average of Jij{a,L) = 
0(/ci,L(Cj) Cj)) exp[/Q,^2.(?ji Cj)]) calculated over all possible matchings between and ^j; this point 
will be deepened in Sec. |3.2[ 

We conclude this section with a last remark. The idiotypic network describing the mutual inter- 
action among lymphocytes just stems from the affinity between the relevant antibodies calculated 
according to Eq. (3.2). In fact, as underlined before, (even when quiescent) lymphocytes produce 
(low) quantities of specific antibodies which constitute the means through which lymphocytes in- 
teract with each others. To fix ideas, let us consider lymphocytes denoted as i and j, producing 
antibodies described by and (^j. If the affinity between i and j is positive, i.e. Jij > 0, when i 
is firing it will secrete large amount of specific antibodies eventually detected by j which will be 
in turn stimulated to respond. Vice versa, if the affinity is negative, i.e. Jij = 0, then i and j 
are not directly aware of their reciprocal state as antibodies are "transparent" for j's receptors. 
Therefore, the affinity pattern between antibodies does generate the lymphocyte network. Indeed, 
as shown in the next section, Eq. (3.2) allows to completely describe the topology of the emergent 
idyotipic network. 



3.1 Graphs 

The system of A'^ lymphocytes interacting pairwise with a coupling Jij can be envisaged by means 
of a graph Q, whose nodes represent lymphocytes and a link between them is drawn whenever the 
pertaining coupling is positive. Before proceeding, it is worth recalling that a generic graph Q is 
mathematically specified by the pair {V^,r} consisting of a non-empty, countable set of points, V 
joined pairwise by a set of links F. The cardinality of V is given by |y| = representing the 
number of sites making up the graph, i.e. its volume. From an algebraic point of view, a graph 
Q = {V, F} is completely described by its adjacency matrix A: Every entry of this off-diagonal, 
symmetric matrix, corresponds to a pair of sites, and it equals one if and only if this couple is 
joined by a link, otherwise it is zero. The number of nearest-neighbors of the generic site i, referred 
to as coordination number or degree, can be recovered as a sum of adjacency matrix elements: 

In our model the graph describing the interaction among lymphocytes is a random graph where 
links are drawn with probability Pa,L which, in general, depends on the way strings ^'s are extracted 
and on the the way affinity f^^L is defined. 

Here, due to the uniform distribution underlying the extraction of ^'s, we have that the prob- 
ability that and are complementary equals 1/2 independently of i,j and fi. Therefore, the 



^henceforth we will drop the dependence on a and L, if not ambiguous 
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Figure 3.1: Representation of the idyotipic network. Each clone is represented by only one of its 
lymphocytes; the thickness of links denotes the strength of the corresponding coupling. 



probability that they display Cij (hereafter simply c) complementary entries follows a binomial 
distribution which reads off as 

nc)=(l:Y('^. (3.4) 



Correspondingly, we have that lymphocytes i and j are connected together, namely that fa,Li^i,£,j) > 
0, when Cjj(a + 1) — L is positive (see Eq. 3.2) and this occurs with probability 



Pa,L = Vic), 

c=[L/{a+l)J+l 



(3.5) 



where [xj = max{n G N\n < x}. 



The link probability Pa,L (see Eq. (3.5)) is, at least for large L, independent of the chosen 



couple, hence giving rise to an Erdos-Renyi graph G{N,pa,L) [38j characterized by a binomial 
degree distribution 



(3.6) 



representing the probability that a generic node has k nearest neighbors; the average degree follows 



as (k) = Pa,L{N — 1), or, more simply, for large, we use (k) = Pa,LN. In Fig. (3.1) we show 



the agreement between numerical data and analytic estimates (Eq. 3.6) for the degree distribution 



P{k)] different values of A'^, L, and a are considered. The good agreement among data corroborates 
the analytical derivation based on the lack of correlation among links. 
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Figure 3.2: Degree distribution P{k) for different values of A^, L and a; data from numerics (•) and 



analytic estimates (green lines), see Eq. (3.6), are compared. 



3.2 Dilution 



The link probability pa,L defined in Eq. (3.5) yields information about the dilution of the graph: 
the larger Pa,L, the more connected the graph. For instance, at given L, the dilution of the graph 
can be controlled by properly tuning the parameter a. 

As well known, by increasing the link probability from upwards, the (infinite) Erdos-Renyi 
random graph undergoes a percolation transition; namely there exists a critical link probability 
Pc such that when the link probability starts to get larger than pc a so called "giant component", 
displaying a size 0{N), i.e. infinite in the thermodynamic limit, suddenly appears |38J. 

Indeed, the Erdos-Renyi random graph Q{N,p) can be obtained from the complete graph of 
N vertices, K]\f, by retaining each edge with probability p and deleting it with probability 1 — 
p, independently of all other edges. Analogously, the topology of the idiotypic network we are 
introducing in this work can be recovered from i^'^r by conserving and erasing links with probability 
Pa,L and 1 — Pa,L, respectively. 

The Molloy-Reed criterion for percolation |39| shows that, for this model, a giant component 
exists if and only if p is larger than More precisely, setting p = {k)/N, if we denote with 

Ci the largest component in Q{N,p) and with |Ci| the cardinality of the set Ci, then we have the 
following results (see |40j): if {k) < 1, then with high probability (w.h.p.) |Ci| ~ logA^, if {k) > 1, 
then w.h.p. \Ci \ ~ iV, while if {k) = 1, the situation is more delicate and one can state |Ci| ~ N"^/^ . 

Therefore, it is important to analyze in more details the behavior of Pa,L as a function of a and 
L. For a = 1 it is straightforward to see that pi^L = 1/2, due to the symmetry of the distribution 
V{c) with respect to c = -L/2 



More generally, for large L we can adopt a continuous description and write Pa,L (see Eq. (3.5)) 



^due to discreteness, for small L this holds rigorously only for L odd, while for L even pi^L approaches 1/2 from 
below as L gets larger. 
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as 

Pa,L ~ / V{c)dc^ / \l — e dc (3.7) 

(3.8) 

where we replaced the distribution V{c) with the normal distribution, having mean L/2 and variance 
L/4; in fact, for L large enough, the skew of the distribution V{c) is not too great and we can 
approximate the binomial distribution by the normal distribution [35]. From Eq. 3.7 we can calculate 
the derivative of pa l with respect to a, which reads off as 




dp, 



'a,L 



2L 



da 




1 



vr (1 + a) 



re 2° , 



(3.9) 



where we called a = (1 — a) /{I + a). 

We now turn to the coupling strength introduced in Eq. (3.3) and we notice that we can 
write Jij = exp[cjj(a + 1) — L], whenever Cij > L/(a + 1), otherwise Jij = 0. Hence, its mean 
value, averaged over all possible matchings between two binary strings, can be written as (see Eqs. 
(pl),^): 



„c(a+l)-L 



L/{a+l) 




let ("'+6a-3) J 



dc 

+ 4a - 1 [l 
2(1 + a) 



(3.10) 



+ Erf 



1 — a 



Now, we focus on the regime L ^ 1 and, according to the value of the (finite) parameter a, we 
distinguish among the following cases: 

• a = 1 

The expressions in Eqs. (3.8 3.10) can be evaluated exactly obtaining, respectively: 



Pl,L 




dpa,L 

da 



a=l 



and 



a <l 



{J)l,L 




1 L 
-e 2 
2 



i-o\ 

1 pL 
2V 27r' 

1 - O I 



L 



L 

e2pa,L- 



(3.11) 
(3.12) 

(3.13) 



Pa,L 



1 1 



27rL a 



e 2° 



1 + 



(3.14) 
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Figure 3.3: Link probability pa^i for a system of A'' = 4000 nodes as a function of a and of L. 



hence, ^ — )• as L — )• oo. Moreover, for a> -1 + 0.41 



{J)a,L ~ e" 



Ka2+6a-3) 









1-0 








1 









which is diverging for a > —3 + 2\/3 w 0.46. 
a > 1 



e 2 " 



hence pa^^. — >■ 1 as L — t- oo. Moreover, analogously to the previous case. 



{J)a,L ~ e 



^(a2+6a-3) 















1-0 




1 









(3.15) 



(3.16) 



(3.17) 



The asymptotic expressions above are all consistent with numerical results which indeed confirm 
the validity of the Gaussian approximation already for L ~ 10^. Moreover, we notice that in the 
limit L — )• oo the link probability pi^i is a step function with diverging derivative in a = 1 and 



Pa,L = 1 for a > 1, while pa,L = for < a < 1. In Fig. (3.3) we show the behavior of p^^L as L 
and a are varied. 
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In order to characterize the dilution of the graph under study, a proper parameter is the average 
coordination number (k) = Pa,LN, as it represents the average number of hnks stemming from a 
node. In principle, (k) depends on a, L and A^, which in our model cover a well precise physical and 
biological meaning. In fact, while a derives from the chemical-physical interactions arising among 
antibodies and antigens, and can be set independently of and L, the latter parameters N and 
L are intrinsically connected with each other. First of all, for strings of length L, the minimum 
number of agents has to be lower than 2^, if we want to avoid repetitions. Actually, as underlined 



in Sec. (2.2), A^ is expected to be much smaller than 2^. Moreover, a proper scaling of the system 
size should preserve its (global) topological features, namely (k). In particular, (k) must be finite in 
order to have a well-defined thermodynamic limit for N ^ oo |10| [36l |52]; all other cases would be 
either trivial {{k) — )• 0) or un-physical {{k) — )• oo). Thus, on the one hand {k) specifies the degree 
of dilution of our idiotypic network, on the other hand it crucially affects the statistical mechanics 
of the whole system. Therefore, it is natural to describe a system by means of the three parameters 
a, L and (k). Then, the number of nodes A^ follows as 

(k) 2(k) 
^"'^ Erf ( ,/|) - Erf (aVf 



where we used Eq. (3.8|. In particular, for a < 1, one can write (see Eq. 3.14) 



N ^ {k)a , (3.19) 



which should be compared with Eq. (2.2), to get f{L) ~ \/L. 

Finally, we notice that several independent experiments, lead on natural antibodies in neonatal 
mice, have evidenced that the network is highly connected: each idiotype is able to recognize on 
average 20 — 25% of a given panel |68 | l66 | l67]. However, such connectivity decreases with time and it 
is expected to reach a steady state value, as corroborated by higher values of dilution in adult mice 
|72) : in particular, in |73| the connectivity in adult immune systems is estimated around 3 — 5%. 
Following these data, in our system, meant for a mature immune system, the link probability p^^L 
is expected to be approximately 0.04, which provides a first hint for selecting the region a < 1. 
Moreover, recalling A^ ~ 0(10^^), we consistently expect {k) ~ 0(10^^). Therefore, in our model 
a realistic system may be obtained by fixing a = 0.7, L = 140 and {k) ~ 0{W^'^), then from Eq. 



(3.7) we get pa,L ^ 0.04, from which we recover A^ ~ 0(10^^); the whole framework is therefore 
quantitatively consistent with real data. 

We conclude this section by showing a typical topological structure corresponding to parameters 



a = 0.7 and L = 80, see Fig. 3.2, left panel; a comparison with the network obtained experimentally 
in [28], right panel, is also provided. The similarity between the two structures is manifest and 
suggests that the Erdos-Renyi topology which emerges from our minimal assumption is consistent 
with real data. 



3.3 Weighted connectivity 



In Sec. (3.1) we introduced the degree ki which represents the number of lymphocytes "in contact" 



with the lymphocyte labeled as i and making up the set denoted as Vi Q V. This means that the 
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Figure 3.4: Left panel: Idiotypic network obtained for a = 0.7, L = 140; for the sake of clarity we 
fixed a small number of nodes = 30. Right panel: Representation of the connectivities among a 
group of neonatal antibodies found by Varela and Coutinho in |28j. 




lymphocyte i, can interact with lymphocytes in Vi through the pertaining antibodies described by 
the string ^j. 

The coordination number has been shown to play a crucial role in the reactivity of antibodies ^7} : 
the patterns of cross-reactivity between collections of idiotypes have been organized by experimental 
immunologists in matrices which are just the adjacency matrices describing the affinity among 
idiotypes. Such matrices have been revealed to be be arranged in blocks: a high-connectivity block 
(including nodes characterized by large degree), a "mirror block" (intermediate degree) and a low- 
connectivity block (small degree). These blocks were analyzed in their independent contributions 
through simulations by Varela et al. [27] who concluded that the larger the degree, the lower 
the reactivity of the corresponding lymphocytes and the greater their degree of tolerance. Hence 
the various groups play different roles: the mirror group accounts for intrinsic oscillations, while 
highly connected nodes may act as initial organizers of the immune system. In this framework, and 
according to the autopoietic view, autoimmunity arises not because of the presence of self-reactive 
clones, but because such clones are or become "not properly" connected to the network. As a result, 
self/non-self discrimination turns out to be an emergent property of the immune network which is 
therefore able to organize the mature repertoire. It follows naturally that establishing the structure 
of the immune system is a task of great importance as it would allow to figure out possible strategies 
to cope with autoimmune diseases. 

In our model the adjacency matrix is actually weighted since links are endowed with a weight 
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Jij, which allows to mtroduce a weighted degree Wi as 

N 

Wi{a, L, {k)) = ^ Jij{a, L). 

3=1 



(3.20) 



Notice that the local quantity Wi provides finer information with respect to fcj, being directly 
connected with the "internal" stimulus felt by lymphocyte i: recalling the Hamiltonian of Eq. 



(2.6), and assuming, for the sake of simplicity, the zero noise limit so that all lymphocyte in Vi are 



quiescent {nij = — 1, Vj € Vi), the local field acting on i is just ipi = — "^f^i Jijiri 



Wi. 



For a given system (a, L, (k)) the average weighted degree can be calculated as 

L k k ^cJa+l)-L 

k 



Cl,C2,...,Cfe=L/(Q+l)i=l i=l V ij 



(3.21) 



Actually, it is convenient to introduce the "quenched averages" J{a,L) and w{a,L, {k)), obtained 
by averaging the couplings Jij and the weighted degree Wi over all links and nodes, respectively, of 
a given realization, namley 



J 



N{N -I) 



J, 



and 



l^i=l Wi _ Z^i=l l^j=l ^tj 



W 



N 



N 



(iV-l)J. 



(3.22) 



(3.23) 



Now, for large N and L the "quenched averages" J{a, L) and w{a, L, (k)) converge to the "ensemble 
averages" {J)a,L, that is {w)a^L,{k) ^ {N — l){J)a,L and, being that {J)a,L equals one by definition, 
we have that {w)a^L,{k) scales linearly with A^. Analogously, due to the uncorrelatedness among 
Jjj's, one can use Bienayme prescription and write 



N \ N 

Vs.T{wi) = Var I Jij = Y,y3.T{J,j) = NVaT{Jij) 
d=i / J=i 



(3.24) 



where Var(x) = — = o"^ is the variance of the variable x, that is the expected value of the 
square of the deviation of x from its own mean x. Now, the variance for Jij can be estimated via 



Eq. (3.3) and Eq.(3.4| 



exp[2c(a + l)-2L]y-e 
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Figure 3.5: Standard deviation a;^ as a function of the system size N; the parameter L is properly 
rescaled in order to keep (A:) fixed and equal to 60 (red) or to 100 (black); different symbols represent 
different choises for a, as shown by the legend. The straight line represents the first bisector. 



Now, with some algebra and recalling Eq. (3.10), we get the following estimate 



{J' 



Erf(^Vf )-Erf(aJf 



1 2 



lgf(-a2+2a+l). 



a 



l-O 



L 



(3.25) 



(3.26) 



After noticing that, for 1 — \/2 < a < l + \/2 the exponent is positive, yielding {J'^)a,L ^ {J)a L ~ 
we can write the standard deviation for the coupling strength as 



Moreover, one can write 



J_^^{-a2+2a+l) 



L e' 



L (-2a^ + 9ci^+6a + 3) 



(3.27) 



(3.28) 



where in the last expression we used Eq. (3.19) 



In Fig. (3.5) we show, as a function of N and for several choices of a, the standard deviation 



o"^ notice that while is varied, L is properly scaled in order to keep {k) fixed. The log-log scale 
plot highlights a regime, for large enough A^, where a power law growth for cr^^ holds. 
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3.4 Circuits 

In this section we want to analyze the number and the relative weight of small loops present in 
the random graph G{N,pa,L), previously introduced to describe the idiotypic network. This kind 
of information allows not only to deepen the topological description of the immune network, but it 
will also be useful in the following sections when studying the system response to external stimuli. 

In fact, we recall that due to the lacking of a perfect match among antibodies, a given lympho- 
cyte, say ai, undergoing clonal expansion, may elicit one (or more) of the best Jerne counterparts 
(even spurious state may respond), say (72- The latter undergoing clonal expansion too, may elicit 
another lymphocyte among the best Jerne spurious state, say as, and so on. Now, since cti and 
(73 both have large affinity, i.e. complementarity, with the same state (72, they are expected to be 
similar. Analogously, 174 is expected to be similar to a2 and therefore to disply a large affinity with 
both (Ti and a^- As a result, such loops built by four lymphocytes which are mutually Jerne states 
are expected to be more stable than the loops built by three lymphocytes. 

Of course, again due to the multi-attachment (able to generate spurious states) the information 
gets lost when increasing the size of the loop such that large loops are unexpected; in the following 
particular attention will be paid to loops of length 3 and 4. 

Let us now formalize and analyze mathematically the problem. First of all, we define a circuit 
of length / as the edge set £1 of an undirected closed path without repeated edges, that is ii = 
{(n,i2),(«2,«3),--, {il,h)}, with {ik,imod{k+i,l)) ^ T, for any k G [1,/]. 

Then, we denote with n/ the number of circuits of length / present in the graph; it's worth 
recalling that ni is a purely topological quantity depending only on the adjacency matrix A. Now, 
the number of possible circuits reads as yiJW^.' ™ ^SiC^, choosing such a circuit implies to select 
an ordered list of I vertices, modulo the orientation and the starting point of the path. Now, for 
an Erdos-Renyi random graph the probability for a circuit to be effectively present in the network 
only depends on its length, being given by the link probability to power I; in particular, here we get 

For short cycles with I <^ N, we can approximate the previous expression as 

where we used that the average degree in Q is {k) = Pa.liN — 1). Therefore, above the percolation 
threshold, the number of circuits grows exponentially fast with their length. 

It is also possible to calculate the number of circuits of length I, such that they include a node 
of degree k; this is simply given by 

where the last expression holds for I small and k large. As a consequence, as I is increased, the 
number of circuits increases exponentially and the rate of growth increases with k. 

As underlined before, our network can not be described in a purely topological way, i.e. in terms 
of the adjacency matrix only, as the coupling strength associated to each link has an important 
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physical meaning. Consequently, circuits should also be measured according to the couplings Jij, 
or weights Wi, of the pertaining links or sites, respectively: the overall strength J^^ associated to the 
circuit denoted as ii = {(^1,^2), (^2)^3)) •■•) {il,h)}, is therefore given by 

1 ' 

M = -l^Jik,ik+l^ (3-31) 



k=l 



being iij^i = fi, while the overall weight is 



1 ' 



k= 



Notice that Ji^ represents the intrinsic robustness of the circuit while VJl^ represents the overall 
(relative) influence from the external environment to the circuit In the following we highlight 
the role of the quantities J^^ and of Wl^ , by considering a special situation. 

Let us assume, for the sake of simplicity, that we are in the zero noise limit, so to discard the /3 
dependence of the quiescent state. In this condition, and in the absence of external stimuli we have 
ruk = — 1, VA; G V . Now, when a sufficiently high concentration of the antigen is introduced, the 
ith clone will undergo a clonal expansion, so that rrii > —1. 

Then, the stimulus can spread from i to nodes in Vi and so on throughout the network in a 
cascade fashion, possibly coming back to i, hence providing a reinforcement feedback. In this case 
we say that a "firing circuit" has established. Given a circuit li we say that it is firing if mj^. > —1, 
for any k £ [1,^]- The magnitude of the firing circ uit c an be measured in terms of global firing 



concentrations, namely Ylk=i ^ikl^ ^ [Ij-^^li see Eq. (2.4). 



Due to self-reinforcement, a firing circuit can survive even when the external stimulus has ex- 
pired; the long-time persistence of a firing circuit can be estimated by means of the ratio J(,/wf. 
the larger the ratio, the more important the self-reinforcement with respect to the neighborhood 
(possibly non-firing) and therefore the more likely the persistence. Interestingly, the persistence of 
firing circuits yields storage memory of previous infection, hence, finding the conditions for their 
establishment can be very important. 

In this context we are interested in short circuits rather than long 0{N) ones, the latter evidently 
require more strict conditions for their establishment and should actually be avoided as they would 
correspond to a broad response involving most lymphocytes, including those directed against self. 
In particular, we focus the attention on circuits of length / = 3 and / = 4, which are expected to 
result in sensitively different overall strengths Jg. In fact, the former corresponds to a frustrated 
configuration giving rise to a relatively small overall strength. More precisely, since links derive 
from a large degree of complementarity between the two adjacent nodes, circuits of odd, small 
length must display at least one weak edge; on the other hand, when the length is even this kind of 
frustration can be avoided. 

As for the overall weight wi, its value strongly depends on whether the circuit contains a highly- 
connected node, namely a node belonging to the left-hand side of the distribution P{w); indeed, 
as we will see in the following section, such nodes are typically connected with analogously highly- 
connected nodes. 
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Figure 3.6: Distributions for overall strength Jg (upper panel) and overall weight (lower panel) 
concerning circuits of length / = 3 (triangles) and / = 4 (squares). We also distinguished between 
circuits passing through lowly-conned nodes (Non-self, represented in red and in pink) and through 
highly-connected nodes (Self, represented in blue and in green), as shown by the legend. From 
the upper panel it is clear that for I = 4 the overall strength is larger than for I = 3. The graph 
considered is made up of = 500 nodes, moreover a = 0.74 and L = 80. 



In Fig. 3.6 we show the distributions obtained for Jg (upper panel) and for W£ (lower panel), 
when considering all the circuits passing through lowly-connected and highly-connected nodes re- 
spectively; both cases / = 3 and I = 4 are considered. From the data depicted in the figure we 
calculated the average overall strength which, for I = 4 turns out to be more than twice the one 
pertaining to / = 3; the former is larger than 1, the latter is smaller than 1 (we recall that 1 is 
the expected coupling strength). In fact, as anticipated, a lymphocyte cJi and its corresponding 
anti-lymphocyte are unlikely to have a strong common neighbour. We also notice that the presence 
of a highly connected node within the circuit has dramatic effects on the distribution for we which 
results to be shifted towards larger values; this means that circuits involving self-addressed nodes 
(i.e. those with high connectivity, vide infra) are also more unlikely to be elicited. 
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Chapter 4 

Features of the model 



4.1 Self/Non-Self recognition 

Let us consider again the whole idyotipic network made of A'^ different clones, each characterized by 
a specific string of L idyotopes; once a is fixed, the affinity between two different nodes is specified 



by Eq. (3.2) from which the coupling in Eq. (3.3) follows. 



Before turning to the analysis of the distribution P{w) and showing how it naturally allows to 
distinguish between self and non-self addressed antibodies, it is worth recalling the famous exper- 
iment lead by Stewart, Varela and Coutinho |27l 128) : they measured the affinity of a collection 
of antibodies and analyzed the related affinity matrices finding that these matrices are organized 
in blocks. More precisely, they distinguished a high-affinity block, two blocks of groups which are 
mirror of each other, and a low affinity remnant; then they showed that various groups play different 
roles: the mirror groups provide their model with various oscillations periods, while highly connected 
nodes maintain a "basic network background level" and may be looked at as self- addressed anti- 
bodies. Indeed, their large connectivity prevents them from readily react to a stimulus. This point 
of view is extremely interesting as it outlines a natural interpretation of the topological properties 
of the immune network. Not only, from an autopoietic point of view, it also sheds light on au- 
toimmunity diseases: their origin would therefore lay on the "inadequate connection" of self-reactive 
clones. 

Let us now consider the idiotypic network introduced in the previous section: with respect to 
the model introduced by Coutinho and Varela |28) . here each link stemming from a given node i 
has its own weight, which measures how strong the affinity between the relevant antibodies is, in 
such a way that, the information carried by Wi is much reacher than the one carries by ki. Hence, 
we will follow the experiment by Stewart, Varela and Coutinho |27| 128) by looking not at the degree 
distribution P{k), but rather at the distribution P{w). 

We considered different systems (a, L, (k)) and by numerical analysis we derived the distribution 
P{w), which, on a semilogaritmic scale, can be properly fitted by a Gaussian distribution; the 



relevant best fits are represented by the green curves in Fig. 4.1 Such distributions naturally 
outline three main groups characterized by high (right-hand-side tail), intermediate (central region) 
and low (left-hand-side tail) weighted degree, respectively. Hence, recalling that a large weight 
implies a low reactiveness (see previous section), lymphocytes displaying low and high weighted 
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degree can be labelled as non-self and self addressed lymphocytes, respectively. It is important to 
notice that, since the distribution P{w) covers several orders of magnitude, the former will easily 
react even by low dose of nearest-neighbors (or antigens) (implicitly defining the low dose tolerance), 
while, for larger w, the ability to react decreases progressively, up to prohibitive values of antigenic 
concentration. 

Now, starting from P^w) we want to focus on couples of Ig and anti-Ig and figure out possible 
correlations in their weighted degrees. We first select non-self addressed lymphocytes, namely modes 
in the network corresponding to the left-hand side of the weighted degree distribution, and we look 
for their most tightly connected neighbors among the remaining — 1. This way, we distinguish 
couples {i, i), where i should be meant as a lymphocyte producing Ig directed against non-self agents 
and i as a lymphocyte producing so called anti-Ig able to respond to a significant growth in Ig's 
concentration, according to Jerne's idea of idiotypic network. 

As shown in Fig. (4.1), when i belongs to the low weighted-degree region, the corresponding i 
typically falls in the intermediate region of the distribution, hence fitting the "mirror block"; this 
holds for several choices of a, L and (k) (see panels a, b and c). 

Let us now turn to the right-hand side of the weighted-degree distribution and, analogously, 
we distinguish couples where j represents a lymphocyte producing Ig directed against self 

agents and j as the relevant anti-Ig able (see panel d). In this case anti-Ig still belongs to the 
highly-connected group, that is they should as well be meant as directed to self-agents. This result 
is easy to see: Since by definition j exhibits a large weight wj, it follows that, typically, Jjj ~ Wj as 
the main contribution to Wj comes from Jjj and, analogously, Jjj ~ wj. Otherwise stated, when a 
highly connected node is selected, there exists a correlation between Wj and wj; on the other hand 
when a lowly connected node is considered, the contribution of J{i to Wi and to uq, respectively, is 
small enough not to bias wj. The very origin of such a different behavior of self and non-self anti-Ig 
lays in the wide range spanned by w. 

As deepened in the following, anti-Ig's play a crucial role in the establishment of memory effects, 
so that the "mirror block" here acquires the fundamental function of memory storage. Interestingly, 
such a memory storage here turns out to be effectively managed since it is restricted to non-self 
directed Ig only. Conversely, self directed Ig and relevant anti-Ig both set up the highly-connected 
group. 

Another point worth being underlined concerns the affinity between Ig and anti-Ig; the affinity 
can be evaluated from the number of matchings Cij, whose distribution is represented in the insets 
of Fig. ( |4.ip : due to the uniform distribution underlying the extraction of (^'s, the relative matching 
Cij/ L resulting from all possible pairs is distributed around the value 1/2 with a standard deviation 
scaling as \l\fTj. Hence, the expected affinity for Ig and anti-Ig can be estimated as 1/2(1 -|-3/\/L)- 
Recalling that in our model each entry in represents an epitope and that each Ig displays 0(10^) 
epitopes, we have that the relative matching between Ig and anti-Ig falls in between 0.6 and 0.7. It 
is interesting to stress that experimental values are bounded by 0.6 (and in general larger): This 
can be understood by analyzing a I = A Jerne loop and measuring the binding ability of the last 
antibody Ab4 with the first Abl. On average > 60% of Ab4 molecules are able to link Abl |48j. 

The consistency among such data confirms the plausibility of interpreting ^ as a string of 0(10^) 
epitopes (even thought improvements in the binding percentage should be achieved by using more 
complex epitope distribution probabilities). Also, the relative small affinity found experimentally 
among most-tightly nodes corroborates the fact that the system is far from complete, namely that 
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Figure 4.1: Weighted connectivity distributions (green line) for systems made up N = 4000 
lymphocytes characterized by idiotypic strings of length L = 120 and a = 0.74 (panel a), L = 120 
and a = 0.82 (panel b), L = 100 and a = 0.78 (panel c,d); the average connectivity (k) gets 240, 
630 and 290, respectively. In blue we show the distribution of low-connected clones (panels a, b and 
c) or high-connected clones (panel d) chosen and in red the distribution of the pertaining "anti- 
clones". Notice the semilogarithmic scale plot. The insets show the relevant matching Cij among 
all the couples Ig and anti-Ig detected in the whole system. 
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N ^ 2^, consistently with the assumption of Eq. (2.2). 



4.2 Low-dose tolerance 

In this section we want to investigate the effects ehcited by a concentration c of a given antigen. 
Let us consider the antigen with specificity S^f^i = namely displaying perfect match with antibody 
^j. The presence of a concentration c of the antigen can be incorporated within the Hamiltonian H 
describing the system by introducing an external field h', whose element /i^ represents the coupling 
with the k-th antibody, namely 

hi = exp[/„,i(Cfc,e^O]0(/a,L(6,4O)- (4.1) 

Indeed, the coupling strength between antigen and antibody is calculated according to the rule 
introduced in Chapter [3] for antibody- antibody interaction since the forces underlying the couplings 
are of the same nature. Therefore we can rewrite the Hamiltonian (2.7) as 

^ N,N N 

H{a,J,h) = --^ ^ Jkjmknij + /i^mfc, (4.2) 

k<j k=l 

where c can be possibly tuned to mimic variations in the antigen concentration. This way, an 
arbitrary lymphocyte k is subject to two stimuli, one deriving from the presence of the antigen, and 
the other from the presence of the remaining lymphocytes. This can be formalized by saying that 
the field acting on the k^^ node is 



In the absence of any antigen it is reasonable to consider all lymphocytes in a quiescent state, 
i.e. nik = — 1 (under the assumption of negligible noise) for any k] this provides the initial state 
assumed to be stationary when no antigen is at work. Hence, as the field h' is switched on, we have 

1 

Hk = j^Wk -chl, (4.4) 



where we used Eq. (3.20). Now, if occurs to be negative, the state for the fc*'^ lymphocyte which 
minimizes the energy is the firing one, namely = +1. Hence, assuming that all lymphocytes are 
quiescent, the condition for lymphocyte k to fire is 

chly"^. (4.5) 

This means that the minimal concentration necessary in order to elicit an immune response by k 
is directly proportional to its degree Wk and inversely proportional to its coupling h^.. This also 
suggests that, in the presence of the antigen ^^i, the most reactive idiotype is not necessarily ^i, 
but rather it may be a spurious one which exhibits the lowest ratio Interestingly, the threshold 



mechanism determined by Eq. (4.5) consistently mimics the low-dose tolerance phenomenon: The 
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Figure 4.2: Threshold concentration c of antigen ^/ji as a function of the weighted connectivity Wi of 
the first reactive family, in systems with parameters = 1000, a = 0.84, (k) ~ 150 (triangles) and 
A'^ = 3000, a = 0.74, (k) ~ 40 (circles), respectively; for both cases we used M = 100 and L = 140. 
The level of noise is set as /? = 1.0, far above the critical value. 



immune system attacks antigens or, more generally proteins, if their concentrations is larger than a 
minimum value, which depends on the particular protein. 

Implicitly this mechanism suggests possible interpretation even of the high dose tolerance: as 
what elicits a given lymphocyte is the product of the weighted connectivity with another agent 
(antigen or internal molecules) times its concentration (properly expressed via a magnetization 
function), it can not distinguish among self or antigen in an high dose. 

Responding to high dose of antigen should, in principle, allow a response even to the self, whose 
defence turns out to be a primarily goal. 

These analytical estimates have been checked by means of numerical simulations: For a given system 
(a, L, (k)) we run several experiments, each for a different applied field ^f^i, where the concentration 
of the antigen is tuned from up to the minimal value c* necessary to elicit an immune response; 



data are reported in Fig. (4.2). On the x-axis we set the weighted degree of the first reactive 
lymphocyte and on the y-axis we set the minimal concentration c of the agent ^/ji able to give 
rise to an immune response, multiplied by = exp(aL); a linear dependence between w and c is 



evidenced by the fit, in agreement with Eq. (4.5). We therefore recover the important result from 



Varela et al |27| [2H] that the reactivity of an antibody is closely related to its degree, where, here, 
the degree is more specifically meant as weighted degree. 

The linear scale between c and w has some significant consequences: The tolerated concentration 
of antigen directly reflects the (weighted) inhomogeneity of the graph. Otherwise stated, if the 
weighted degree spans a range, say, 0(10^^), the tolerated concentrations relevant to all lymphocytes 
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making up the system is expected to span an analogously wide range. Hence, recalling that non-self- 
addressed Ig's belong to the left tail of the weighted-degree distribution, while self-addressed Ig's lay 
on the right tail, we have that the doses typically tolerated by the former are k order of magnitude 
less that those tolerated by the latter. Now, as shown in Sec. 3.3, the weighted-degree distribution 
P{w) exhibits a standard deviation scaling exponentially with L or, analogously, algebraically with 
N, being 1/2 a lower bound for the exponent. As a consequence, we expect that the region spanned 
by w grows non-slower that \/iV ; this means that for real systems the difference between doses 
tolerated by self and non- self is at least O(IO^). 

We finally stress that the low-dose tolerance emerges as a genuine collective effect directly related 
to the properties of the idyotopic network and, in particular, on the distribution of the weighted 
degree. 



4.3 Multiple responses and spurious states 



As explained in Sec. 4.2 the introduction of a concentration c of a given antigen described by the 
external field h' is able to increase the magnetization (concentration) of the node (lymphocyte) i, 
provided that c is sufficiently high. In general, if the concentration is large enough, several clones, 
different from i, may prompt a response: some of them, say ji,...,jp, (hereafter called spurious, 
once again in order to stress similarities with neural networks |9]) respond because of a non- null, 
though small, coupling with the external field, some others, say j[,...,jp, (hereafter Jerne states 
for consistency) respond because they display a strong interaction Jij with the formers or with the 
specific Ig i. Spurious states can be very numerous according to the particular antigen considered 
and to its concentration; under proper conditions the response of spurious states can be even more 
intensive than the specific response from i. In fact, the reactivity of a given node j is determined 
not only by the relevant antigenic stimulus hp but also by its local environment, namely by the 
concentration of firing lymphocytes to which j is connected. 

While in a neural networks framework spurious states correspond to "errors" during the retrieval 
(once a stimulus is presented) and should be avoided, in immune network spurious states are funda- 
mental for an effective functioning of the whole machinery. In fact, when an antigen is introduced in 
the body, all the set of responders (proper lymphocyte and spurious states) do contribute to attack 
the enemy and neutralize it. Moreover, the reaction of spurious states can in turn have important 
consequences on the generation of memory cells and on the effectiveness of the secondary response. 
Accordingly, one can investigate whether it is possible to figure out proper strategies which can limit 
or increase the number the number of such spurious states. In particular, how the connectivity of 
the structure and the coupling patters hi. influence this? 

Here, we just want to analyze the overall response of the system outlining which kind of clone 
does react, that is, we distinguish between spurious states and Jerne states, i.e. anti-Ig. Results for 
different realizations of a system (a, L, {k)) where the antigenic concentrations is set as c ~ lO'^c are 



shown in Fig. (4.3); different symbols are used for spurious states (triangles) and for Jerne states 
(cirlces). For such concentrations the number of reactive spurious states is approximately twice the 
number of reactive Jerne states and a clear correlation between their weighted connectivity and 
Jj'ij (Jerne state) can also be evidenced. Interestingly, Jerne states require a larger stimulus to 
react and this is due to the fact that the reaction is not directed, but rather mediated by the specific 
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Figure 4.3: Analysis of spurious states for different realizations of a system made up of = 1000 
families and M = 10 clones per family; we assumed a = 0.84 and L = 140. Left panel: Field 
coupling h'j (for reactive spurious states (triangles)) and interaction strength Jij (for reactive anti- 
antibodies (circles)) as a function of their weighted connectivity; each realization is depicted in a 
different color. Right panel: Schematic representation of connections between reactive antibodies. 

Ig z or by a spurios state j. 

Furthermore it is also important to stress that apparently, without the introduction of spurious 
states, the amount of antibodies is greater than the amount of lymphocytes and this would be 
in conflict with the first postulate of immunology: consistency is obtained thanks to the lack of 
a perfect match among antibodies (or antibody and antigen), which allows multiple attachments 
ultimately accounting for a large over-counting of different responses. 



4.4 Dynamical Memory 

As well known, the immune system is able to develop memory effects; for this to happen the mutual 
interaction among lymphocytes is crucial. The activation of a lymphocyte i must therefore be 
followed by the activation of the relevant anti-antibody i, which, in turn, may elicit the anti-anti- 



42 



CHAPTER 4. FEATURES OF THE MODEL 



anti-body i and so on in a cascade fashion. It is just the modulation and mutual influence among 
such interacting antibodies to keep the concentration of antibodies themselves at appropriate levels, 
which provides memory storage within the system. In this section we want to analyze under which 
conditions, if any, a firing state of lymphocyte i, i.e. rrii = 1, can determine a non-null concentration 
for the anti-anti-body i to react. 

Let us consider a system characterized by parameters a, L and {k), in such a way that is 

1 for any k ^ i, we have that , all in 
1 families 



determined by Eq. 3.18 Assuming that rrii = 1 and ruk - 
all, node i subject to a field H-^ given by the presence of the others N 



Hi 



rui + Jfirui 



which can be rewritten as 



where we used Jij = Wi. We therefore derive that i is also firing if 



(4.6) 



(4.7) 



(4.8) 



As shown in Sec. 4.1 anti-antibodies corresponding to non-self addressed Ig's typically belong to 
the so called mirror-block of the affinity matrix and they display and average connectivity ~ 
{J)a,L{N — 1). Moreover, the affinity between i and i can be estimated as J^i ~ {J)a,L + '2o'^ l, since 
the coupling between Ig and Anti-Ig lays on the right tail of the coupling distribution. Therefore, 
recalling {J)a,L = Ij we can rewrite Eq. 4.8 as 



A^ - 1< 2(1 + 2air) 



(4.9) 



Now, we can use Eqs. 3.18 and 3.25 to write the previous expression as a function of L, a and (A;): 

2{k) 



Erf 



Erf ( aj^ 




(4.10) 



A better insight in the previous expression can be achieved from Fig. |4.4| which shows its nu- 
merical solution for different values of {k) (each shown in a different color): for a given average 



degree (k), the region of the plan {a,L) contained within the pertaining satisfies Eq. (4.10). For 
instance, let us assume {k) = 10^^ and L = 140, then a must be not larger than approximately 0.75 
if we want that a response from the anti-anti-Ig follows the reaction of a specific Ig. By analyzing 



Fig. 4.4 wenotice that the less diluted the network the smaller the region of "retrieval"; Indeed, if 
we fix a given point on the (a,L), increasing (k) implies a larger N and this contrasts with the 
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Figure 4.4: Numerical solution of Eq. (4.10): different values of (k) correspond to different closed 



curves, whose internal region provides the values of a and L which satisfy the inequality of Eq. (4.10 ) 
namely the region of retrieval. 



satisfability of Eq. (4.10), on the other hand this result is rather intuitive as, when the coordination 
is large, the anti-antibody is less reactive with respect to the stimulus provided that the related 
antibody. As for the region corresponding to large L and relative large a, this never overlaps with 
the retrieval region, in fact for those values ^ is relatively small. 

Finally, we stress that when (k) is close to real values, i.e. O{10^^) the retrieval region is centered 
on L ~ 10^ and a between 0.5 and 1, this is consistent with the conclusions drawn from the analysis 



of the network dilution (Sec. 3.2) and from the analysis of sel/non-self recognition (Sec. 4.1). 



4.5 Generation of memory cells 

The last step we perform is to zoom inside the immune system and consider the behavior of single 
clones when stimulated with fields so to secrete immunoglobulins in high concentration; to this task, 
as the antigen concentration varies during the infection (at first increasing than -hopefully- decreas- 
ing) we have to deal with time dependent fields pushing the system away from the equilibrium. 
However for the sake of clearness at first we work out the equilibrium behavior of only two clones 
in interaction with each other and with their corresponding fields, so to have equilibrium even at 
this zoomed level, then, in the other sections, we will study their dynamical features. 

Another interesting property of the immune system is the long-term memory of the past infec- 
tions: When an antigen has been successfully rejected, part of the stimulated lymphocytes (cor- 
responding to clones which have undergone expansion) do not recover the rest but they become 
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"memory-cells", namely they remain activated, such that if the same antigen is re-introduced in the 
body an immediate, and highly specific response, usually improved with respect to the first time, 
can raise immediately. 

The amount of memory cells achieved after an infection is not a constant and it is known to 
depend on the time of the infection and on the kind of the infection [9l [61] . 

We want to show that our model exhibits a phenomenon called "hysteresis" |42[ H3] and this 
may account for the generation of the memory cells, furthermore it can model naturally both 
the improvement of the quality of the antibody production in the second response and the time- 
dependence in the ratio of the obtained memory-cells. 

The hysteresis is a dynamical feature (disappearing in the quasi-static limit [41j) which essen- 
tially arises due to conflicting timescales inter-playing. 

In ferromagnetic materials hysteresis is a well known phenomenon, both theoretically and ex- 
perimentally: When an oscillating magnetic field is applied to a ferromagnet, the thermodynamic 
response of the system, namely its magnetization, will also oscillate and will lag behind the applied 
field due to the relaxational delay. Therefore, the two time-scales inter-playing are given by the 
frequency of the external field u and by the thermalization of the system itself. When relaxation 
is slower than field oscillations we have a delay in the dynamic response of the system which gives 
rise to a non-vanishing area of the magnetization-field loop; this phenomenon is called dynamic 
hysteresis. 

In an immune system the two dynamical phenomena and related time-scales involved are: the 
raise of the immune response (which may depend by the particular clone interested) and the anti- 
genic growth (which strongly depends by the given antigen). When the two subjects are made 
interacting delays in the dynamic response gives rise to several interesting phenomena: at first 
when the concentration of the antigen is bring back to zero at the end of the fight, there can be not 
zero -remanent- magnetization (lacking of the in-phase behavior appears), further, if we deal with 
periodic perturbation, when the time period of such antigenic oscillations becomes much less than 
the typical relaxation time of the clone, a dynamical phase transition toward a chronic response may 
appear. Ultimately this approach may bridge the Barkhausen effect |i41j to the "Jerne avalanches" 
of antibody and anti-antibody, whose distribution and sizes are interesting information. 

Before results are outlined, we stress that we applied sinusoidal fields of the form h{t) = 
hosm{u}t), where ho takes into account the interaction thought the lymphocyte network, while 
UJ rules the timescale of the antigen. 



4.6 Two clones dynamics and maturation of secondary response 

For simplicity, let us start considering only two clones {N = 2) in interaction, as the generalization 
to slightly more involved situations (i.e. four clones) is straightforward. The macroscopic states of 
the two clones are nii = Z]a=i '^i ^^'^ "^2 = SqLi ^2- 

Given these two clones, i and j, their mutual interaction parameter Jjj depends on the subset they 
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Figure 4.5: Examples of hysteresis cycles for a two-body system: on the y-axis we show the conce- 
tration of firing lymphocytes and on the x-axis the amplitude of the external field. Two different 
frequences are considered: lo = 0.1 (left panel) and to = 0.01 (right panel). The level of noise is 
below the critical value. 



belong to, as specified by the symmetric matrix 

P 



P /J 



"11 



V J 



12 



P 

Jl2 = J \ 
J22 = / 



where each matrix block has constant elements: Jn = J22 = 0, as lymphocytes carrying the same 
idiotype do not interact, while J12 = J21 > controls the interaction between lymphocytes of 
different clones. 

Analogously, the field hi takes two values hi and /i2, depending on the type of i, as described 
by the following vector: 



M 



h2 

V / 



This model, two paramagnets ferromagnetically interacting, has two coupled self-consistence rela- 
tions |31| [60] which solves the i — )• 00 limit of the stochastic dynamics, worked out as 

dmi{t) 

dt 
dm2{t) 



dt 



-mi(t) -htanh [P{Ji2m2{t) + hi{t)) 
-m2{t) + tanh f/3(Ji2mi(t) + /i2(i)) )• 



(4.11) 
(4.12) 



Despite its simplicity the phase diagram of these two interacting clones is already rich of both con- 
tinuous and discontinuous transitions [311 [60] and is found to have not trivial stable concentrations 
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Figure 4.6: Hysteresis displayed by the stimulated best matching clone Abl, a spurious clone 
Ab2 and the Jerne counterpart of Abl, namely AAbl. From the picture the maturation of best 
performing response can be understood as follows: at the first infection with the antigen both the 
best matching clone (Abl) and a spurious state (AAbl) are elicited. However Abl experiences an 
higher field such that its saturation in the hysteresis curve is greater with respect to Ab2 and so is 
its remanent magnetization. At the second infection of the same antigen the quiescent state is no 
longer the old one as now different concentrations of the two clones are stored and in particular Abl 
shows higher values than AAbl so its response starts immediately higher and overall the immune 
response is stronger, due to both the remanent magnetization, and sharper, due to the mismatch 
among their relative concentrations. 



of the clones accounting for the optimality of the free energy density. 

To accomplish our task we start applying a field h to the immune system at rest and collect the 
responding clones. 

For these clones we generalize the Langevin equation of the two-body model (eq.s |4.11|4.12 ) so 



to obtain a system of coupled stochastic equations (one for each order parameter of a stimulated 
clone) that we integrate via the step adaptive Runge-Kutta algorithm |69| . 

Roughly speaking, if we define -as a measure of the out-of-phase response- the area of the hysteresis 
loop in the hi , plane as 

A{I3, ho, uj) = j) mdh 

we found that this area is increasing with u at low frequencies (because increasing the frequency 
increases the delay), then reaches a maximum and than start decreasing (due to the 27r /uj period- 
icity); when looking at this area versus the noise level it is seen to increase when /3 increases (that 
means that the affinity matrix can be more felt by the system and consequently its delay increases 



because of the storing of information inside the relative coupling concentrations). In figure (4.6) 
we show a typical behavior (for /3 < /3c) of the first two best fitting clones elicited by an external 
antigen: A proposal for the understanding of the improvement of both the quantity and the quality 
of the secondary response can be obtained from the picture. 
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Figure 4.7: Examples of bell-shaped response for a 2-clones system 

The secondary immune response is stronger because the best fitting lymphocyte (Abl) at the 
second infection do not start off from the minimal allowed value (as the first time) but from the 
value of concentration related to the remanent magnetization. It is also more specific than the first 
response. This can be understood by the following argument: At the beginning all the clones start 
off from the quiescent values. However, the lymphocyte with the best fitting antibody experiences 
an eliciting field stronger than the others (in particular than AAbl) and so it reaches saturation in 
the hysteresis for a longer time. This allows a greater remanent magnetization with respect to the 
spurious state which expanded as well. As a consequence, if the stimulus is presented once again, 
the immune system is not simply translated from quiescence level of concentrations to remanent 
magnetization levels, but different values of the latter, among Abl and AAbl, account for an 
improved response. 




4.7 Bell shaped response 

In this section we want to show that, within our model, the so called "bell-shaped response" [9] is 
recovered as the typical immune response. 

As we are interested in basic features of the immune system, we look at the two most common 
responses to only the positive half of a sinusoidal stimulus: the two-clone circuit and the four-clone 



circuit, which naturally extend the Eqs. (4.11, 4.12), the only difference being the coupling field 



which by now acts only on mi (whose concentration we want to measure). 

Before presenting our results it is worth spending few lines to introduce more clearly our ap- 
proach: usually when dealing with these dynamical features of the immune system, the most intu- 
itive way is to work out time-differential equations for the evolution of the antigenic and antibody 
concentrations (which is indeed what is almost always done |49 | I70 | I7T]. This account for m{t) and 
/i(t), then one, carefully looking at the monotonic regions of the two behaviors, can parameterize 
and get m{h). Within our approach we do not solve this kind of problem, instead we directly give 
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Figure 4.8: Examples of bell-shaped response for a 4-clones system 



an expression for the antigenic load and then we obtain m{h) as a result. This has two advantages: 
this allows to deal with Fourier analysis, furthermore this skips all the troubles about the details of 
the interactions which may strongly depend on the particular antigen |9j . Of course we pay the price 
of testing these responses with ideal mono-frequency viruses which are surely an oversimplification: 
however a more complex behavior can be obtained considering the antigen as a sum of several per- 
turbing harmonics, which is allowed due to the linearity of the Hamiltonian Hi with respect to the 
fields. 

Typical results of bell-shaped found at different field frequency and magnitude are presented in 



the panels of Fig. 4.7 and of Fig. 4.8 



Chapter 5 

Conclusions and Perspectives 



5.1 Summary 

In this paper we pioneered an alternative way to theoretical immunology by plugging it into a 
concrete disordered statistical mechanics framework: our work is not meant as an exhaustive picture 
of the (adaptive response of the) immune system, but rather as a starting point in modeling its 
universal features by means of this technique. 

We stress that, in our model, once the amount of available epitopes and their distributions is 
given (namely the amount of ^'s together with their distribution), everything can be worked out. 
This way, we recover, qualitatively and partially quantitatively, all the basic known features of the 
immune system and we obtain a good agreement with experimental data, starting with a reasonable 
amount of working lymphocytes and antibody concentrations. 

In particular, in the complex system framework we developed, the immune network naturally 
and autonomously achieves/recovers the following properties: 



• the Burnet clonal expansion theory [3][33| appears as the standard one-body response of the 
system described by the Hamiltonian (2.5) (remembering the bridge among magnetization 
and concentration encoded into eq. (2.4)). 

• the multi-attachment among antibodies is a natural property of the system and gives raise to 
the Jerne network (cfr. eq.(3.3)) 

• the Jerne antibody network, which is obtained as a random graph, encodes dynamically the 
memory of the encountered antigens (see fig. (3.4) and fig. (4.4)). 

• the Varela-Counthino self/non-self distinction appears as an emerging property of such a 
network (see fig. (3.6) and fig. (4.1)). 

• the Low Dose Tolerance is the inertia of the network when subjected to respond to external 
fields (see fig. (4.2)). 

• the existence of several antibodies acting against a given antigen, play the role of the dynamical 
spurious states of the neural network static counterpart (see fig. (4.3)). 
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• the High Dose Tolerance appears as a mechanism avoiding the breaking of self-recognition 
(see sec. (4.2)). 

• the genesis of memory cells (accounting for the transition IgG -> IgM in antibody secretion) 
is played by the hysteresis in the network (see fig. (4.5)). 

• the bell-shaped function as immune response is an emergent behavior and not a postulate (see 
fig. (4.7) and fig. (4.8)). 

• the secondary response is stronger and better than the first (see fig. (4.6)). 

• increasing the noise, both the the quality and the quantity of the available retrievals decrease. 

All these different aspects of the immune system appear as features of a whole unified quantita- 
tive and very simple theory. Furthermore, over these agreements, matching with the experimental 
data is available: namely the average connectivity of the network is in agreement with the experi- 
ments as well as the reciprocal affinities of the cascade of complementary antibodies. 

With purely physical eyes our model describes the equilibrium of the immune system as a 
(thermodynamically |34j ) symmetry broken random bond diluted ferromagnet. However, its non 
equilibrium states map the latter into a random field random bond diluted model, conferring to the 
system a glassy flavor. 

5.2 Outlooks 

Among the several outlooks surely the out of equilibrium thermodynamics is to be obtained as 
the model is shown to display a very rich ensemble of timescales and aging is expected. Another 
important point is its learning, that so far is left uninvestigated, which merges the approach of 
neural networks |19j and the dynamical graph theory with information theory. The extension of 
the concept of Hopfield statical memories into a dynamical counterpart should be deepened as well 
as the Gardner saturation bound [TT], which may play a key role in the breaking of defense in the 
body. The transition from a "simple" system to a "spin glass" due to the increase of pasted random 
fields also needs a deep analysis as it is concerned with the genesis of autoimmune responses. The 
interplay among B cells and T helper cells should also be taken into account as T helper play the 
role of a spin glass self-regulation adding a considerable amount of complex self-regulations. At the 
end, as our results are qualitatively quite robust and the framework very stable under the change 
in the epitope distributions, other, mathematically challenging (i.e. due to correlations), choices 
for these distributions are surely biological plausible and should be investigated. We plan to report 
soon on several of the outlines directions of research. 
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